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Background. We performed a clinical audit of preoperative rectal cancer treatment at two European radiotherapy 
centres (Poland and Spain). The aim was to independently verify adherence to a selection of indicators of treatment 
quality and to identify any notable inter-institutional differences. 

Methods. A total of 162 patients, in Catalan Institute of Oncology (ICO) 68 and in Greater Poland Cancer Centre 
(GPCC) 94, diagnosed with locally advanced rectal cancer and treated with preoperative radiotherapy or radio- 
chemotherapy were included in retrospective study. A total of 7 quality control measures were evaluated: waiting 
time, multidisciplinary treatment approach, portal verification, in vivo dosimetry, informed consent, guidelines for 
diagnostics and therapy, and patient monitoring during treatment. 

Results. Several differences were observed. Waiting time from pathomorphological diagnosis to initial consultation 
was 31 (ICO) vs. 8 (GPCC) days. Waiting time from the first visit to the beginning of the treatment was twice as long 
at the ICO. At the ICO, 82% of patient experienced treatment interruptions. The protocol for portal verification was 
the same at both institutions. In vivo dosimetry is not used for this treatment localization at the ICO. The ICO utilizes 
locally-developed guidelines for diagnostics and therapy, while the GPCC is currently developing its own guidelines. 
Conclusions. An independent external clinical audit is an excellent approach to identifying and resolving deficien- 
cies in quality control procedures. We identified several procedures amenable to improvement. Both institutions have 
since implemented changes to improve quality standards. We believe that all radiotherapy centres should perform a 
comprehensive clinical audit to identify and rectify deficiencies. 
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Introduction 

In recent years, interest in improving the qual- 
ity and efficiency of cancer care delivery has be- 
come increasingly urgent as health care costs have 
surged along with increased demand from an ag- 
ing population. In 1999, a report entitled "Ensuring 
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Quality Cancer Care" published by the Institute of 
Medicine in the United States described numer- 
ous quality control issues in cancer care. 1 A major 
recommendation of the report was the need to es- 
tablish a system to measure and monitor quality 
of care through the use of core set of indicators. In 
Europe, the European Union published a directive 
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FIGURE 1. Waiting time from the first visit to start the treatment. 
RT = radiotherapy 



requiring that the implementation of clinical audits 
to improve quality in radiation medicine. 2 3 Quality 
assessment through a system of indicators is still a 
relatively recent practice in radiotherapy and there 
is limited published research in this area. However, 
two recent studies in Italy, one by Cionini et al. and 
another by the Instituto Superiore di Sanita have at- 
tempted to establish quality indicators for radio- 
therapy. 45 

Given the relative paucity of quality control 
studies in radiotherapy, we decided to carry out 
a clinical audit of preoperative rectal cancer treat- 
ment at our two institutions, the Greater Poland 
Cancer Centre (GPCC) in Poland and the Catalan 
Institute of Oncology (ICO) in Spain. 

The aim of this study was to select a set of rel- 
evant quality control measures and then determine 
institutional adherence to these standards in order 
to improve quality at our own institutions. 

Methods 

We elected to use colorectal cancer to perform this 
clinical audit for 3 reasons: 1) In Europe, colorec- 
tal cancer is among the most common cancers, ac- 
counting for 436,000 cases (13.6% of the total) 6 ; 2) 
Both institutions in this study treat large numbers 
of patients for this disease; 3) Given the high in- 
cidence and mortality rates for rectal cancer, any 
improvements in our quality control procedures 
would have a large positive impact on a large num- 
bers of patients. All of these factors made rectal 
cancer treatment an ideal process for comparison. 



TABLE 1. Quality control indicators evaluated 

#1: Waiting time and compliance 

1.1 Time from pathological diagnosis to initial 
consultation. 

1 .2 Time from the first visit to start the treatment 

1 .3. Existence of protocol for unplanned curative 

treatment interruptions 
1 .4 Compliance to the prescribed overall treatment 
time. 

#2: Existence of a multidisciplinary treatment approach 

#3: Portal Verification 

3.1 Existence of protocol for periodic verification of 

treatment fields 
3.2. Number of portal verifications per preoperative 
course of radiotherapy 

#4: Informed consent 

4.1 Existence of signed consent form in patient records 

4.2 Availability of detailed information about treatment 
& side-effects 

#5. In vivo dosimetry 

5.1 Existence of protocol and recommendations for 
checking the entrance dose 

5.2 Number of in vivo dosimetric verifications per 
preoperative course of radiotherapy. 

#6: Guidelines used for diagnostics and therapy. 

#7. Monitoring & review of rectal cancer patients during 
the treatment period. 



Selection of quality indicators and 
standards 

The aim of any quality assessment is to provide 
feedback on meaningful and interpretable meas- 
ures, including cost-effectiveness. 78 Cionini et al 
recently performed a review of the scientific litera- 
ture, including guidelines and national regulations, 
to select quality indicators based on the scientific 
literature to assure the highest strength of evidence. 
For this reason, we selected from the quality con- 
trol indicators described by Cionini, choosing those 
most relevant to colorectal cancer. The following 
indicators were selected: 1) waiting times; 2) multi- 
disciplinary treatment approach; 3) portal verifica- 
tion; 4) informed consent; 5) in vivo dosimetry; 6) 
diagnostic & therapeutic guidelines; and 7) moni- 
toring & review of patient during treatment. Table 1 
provides a description of these indicators. 

Clinical audit 

The clinical audit was performed as a 5-step pro- 
cess. First, each institution selected a multidisci- 
plinary quality evaluation team consisting of de- 
partmental staff with experience in quality assur- 
ance. The 4-person GPCC team was composed of 

1 radiation oncologist, 2 medical physicists, and 1 
quality manager. The 4-person ICO team included 

2 radiation oncologists (one of whom was assigned 
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the role of "quality manager"), 1 medical physicist, 
and 1 statistician. 

We used the International Atomic Energy 
Association (IAEA) QUATRO questionnaire as a 
model for our own modified survey. 6 A checklist 
was created to organize the audit program and to 
ensure coverage of all relevant topics. To ensure 
objectivity, the 2-day on-site clinical audits were 
performed exclusively by the visiting institution's 
team, who collected all necessary data on current 
local practices. All clinical audits were performed 
in the year 2008 by a 2- or 3-person team consist- 
ing of one radiation oncologist (two in the case of 
the ICO) and a medical physicist. The working lan- 
guage of the audit was English. 

The clinical audit was performed as follows: a) 
audit preparation (appointment of auditing team, 
review of the background information prepared by 
the institution to be audited, and preparation of the 
audit program); b) entrance briefing: to introduce 
the auditors to the various staff members and to 
discuss the methods, objectives and details of the 
audit; and c) assessment: on-site clinical audit. 

During the audit, staff members were inter- 
viewed about work practices and approaches, the 
facilities were inspected and all procedures and rel- 
evant documentation (including treatment records 
of the rectal cancer patients included in the study) 
were reviewed. In addition, the auditors observed 
directly the practical implementation of work- 
ing procedures during the 2-day audit, including 
as many aspects of the patient treatment process 
(initial patient examination, diagnosis, evaluation, 
staging, treatment planning and delivery, and fol- 
low up) as feasible. An exit briefing was performed 
to give the host institution preliminary feedback. 

Patients and treatments 

Patient inclusion criteria were as follows: locally 
advanced cancer of the middle and lower rec- 
tum diagnosed and treated with preoperative 
radiotherapy or radiochemotherapy during the 
year 2008. A total of 162 patients were evaluated 
(ICO68; GPCC=94). All patients at the ICO under- 
went preoperative radiochemotherapy, as did 9 of 
the 94 patients from the GPCC; the remaining 85 
GPCC patients received preoperative radiotherapy 
alone. All patients at both institutions were clinical 
stage T3/4 N-/+. 

Preoperative radiotherapy was delivered using 
a high-energy linear accelerator (18 or 20 MV) with 
multileaf collimators and 3D treatment planning. 
All patients were treated in prone position with full 



bladder. At the GPCC, most patients were treated 
with a belly board for small bowel displacement. 
Three field technique to 25 Gy (5 Gy per day) at the 
GPCC or 45 Gy in 25 fractions (1.8 Gy per day) fol- 
lowed by a boost of 5.4 Gy in 3 fractions at the ICO 
and GPCC (9 patients). 

Surgery was performed 6-8 weeks after comple- 
tion of combined radiochemotherapy (ICO) or dur- 
ing the first week after completion of preoperative 
radiotherapy (GPCC). The definitive surgical tech- 
nique included low anterior resection, abdominal- 
perineal resection (Miles technique), Hartmann 
resection or tumour excision. Most patients at both 
institutions underwent surgery following comple- 
tion of radiotherapy. 

Portal imaging was performed on the first day 
of treatment at both institutions. Following proto- 
col, in most cases (85 patients) treated at the Polish 
centre, only one portal check was necessary due to 
the short duration of radiotherapy (5 days). In pa- 
tients who underwent combined radiochemother- 
apy, portal checks were performed every 10 days 
(and prior to the boost) at both institutions due to 
the longer treatment duration. 

Clinical protocols at both institutions call for 
a deviation no greater than 5 mm. If deviations 
were considered excessive, corrections were made 
and the portal repeated. ICO performs either elec- 
tronic or film portal depending on the accelerator, 
whereas only electronic portal imaging is available 
at the GPCC. The portal images are evaluated by 
a physician at the ICO while either a physicist or 
technician performs this function at the GPCC. 
Documentation from portal verification is avail- 
able on the hospital network at the ICO or in the 
patient treatment chart (GPCC). 

In vivo dosimetry was offered only at the GPCC, 
where it is performed in all cases before the first 
session, in the middle of the radiotherapy course, 
after treatment plan change, or on request of phy- 
sician or physicist. Deviations between measured 
and expected dose were considered acceptable 
when they were less than 5% for open fields and 
7% for wedged fields. 

Indicators 

We evaluated seven different indicators (some with 
sub-indicators), described in Table 1. 

Statistical analysis 

This was primarily a descriptive study. Quantitative 
data were analyzed using the Statistica PL 8.0 
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TABLE 2. Portal imaging 



Acceptable 


Unacceptable 


Not performed 


N(%) 


N(%) 


N(%) 


ICO 35(51%) 


31 (46%) 


2 (3%) 


GPCC 78 (83%) 


15 (16%) 


1 (1%) 



N = number; ICO = Catalan Institute of Oncology; GPCC = Greater 
Poland Cancer Centre 



Statistical Software Package (StatSoft, Poland). 
Since numerical variables did not follow normal 
distribution, comparison between the two groups 
was performed using the Mann-Whitney U-test. 
The results of numerical data were expressed as 
median and range. Qualitative data were analyzed 
using Chi-square test of independence or, in cases 
in which zero observed frequencies occurred, the 
Fisher exact test. Statistical significance was estab- 
lished at jt?<0.05 in all the analyses. 

Results 

Indicator #1 . Waiting times and 
compliance to treatment duration 

Waiting time from pathomprphological diagnosis to ini- 
tial consultation. 

The average length of waiting time for this in- 
dicator was 31 days at the ICO vs. 8 days for the 
GPCC, a significant difference (pO.OOOl) Medians 
and range were 28.5 [87] and 5 [36] for ICO and 
GPCC, respectively. 

Waiting time from the first visit to start the treat- 
ment. The average waiting time at the ICO is twice 
that (18 [53] vs. 8 [53]) of the GPCC, a significant 
inter-institutional difference (p<0.0001). 

Existence of protocol for unplanned curative treat- 
ment interruptions. At the time of the audit, only 
the ICO had a protocol in place to compensate for 
unplanned interruptions of curative radiotherapy. 
The GPCC had no guidelines and compensation 
was ad hoc on a case by case basis. 

Compliance to the prescribed overall treatment time: 
treatment interruptions. Most (85 of 94) GPCC pa- 
tients underwent radiotherapy alone (without 
chemotherapy). As a result, the total radiotherapy 
treatment duration was 5 days (1 fraction/day), and 
no interruptions were recorded in these 85 patients. 
In contrast, treatment delivery time was considera- 
bly longer in the patients who underwent combined 



TABLE 3. Percent of patient medical records containing a 
signed informed consent form 



ICO GPCC 



Informed consent 


Pts 


[%] 


Pts 


[%} 


Yes 


61 


89.7 


94 


100 


No 


7 


10.3 


0 


0 



ICO = Catalan Institute of Oncology; GPCC = Greater Poland Cancer 
Centre; Pts = patients 



chemoradiotherapy (all 68 patients at the ICO and 9 
patients at the GPCC). In these cases, radiotherapy 
consisted of 25 or 28 fractions delivered over a 33- 
day period. Of the 68 ICO patients who underwent 
combined chemoradiotherapy, 56 (82%) experi- 
enced treatment interruptions (mainly due to toxic- 
ity, machine malfunctions, holidays or unplanned 
quality control checks) versus 0 out of 9 cases (0%) at 
the GPCC. This large difference (82% vs. 0%) is no- 
table but should not be considered significant given 
the small sample size (only 9 cases) at the GPCC. 

Indicator #2. Existence of a 
multidisciplinary treatment approach 

At the time of study, the ICO had an established 
protocol for reviewing complex cases at a weekly 
interdisciplinary tumour board. No such protocol 
was in place at the GPCC. As per the ICO proto- 
col, cases considered standard were not referred to 
the tumour board. Of the 68 patients at the ICO, 44 
were referred to the interdisciplinary tumor board, 
while 24 (35%) were not. 

Indicator #3. Portal verification 

Existence of protocol/recommendations for periodic 
verification of treatment fields. Both institutions had 
a protocol in place at the time of the study. Portal 
imaging is performed at both institutions on the 
first day of treatment. In the 85 patients who un- 
derwent radiotherapy alone at the GPCC, only one 
portal check was performed due to the short treat- 
ment time (1 fraction/day for 5 days). Portal checks 
for patients undergoing chemoradiotherapy were 
performed every 10 days at both institutions due 
to the longer treatment duration (25 fractions over 
33 days). Portal checks were also performed before 
the boost. 

Number of portal verifications per preoperative 
course of radiotherapy. Table 2 shows the number 
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of patients for whom portal images were consid- 
ered acceptable, unacceptable, or not performed. 
If deemed unacceptable due to deviations greater 
than those set by the protocol, the image was cor- 
rected and portal verification was repeated. 

Indicator #4. Informed consent 8t 
additional explanatory material 

Informed consent. After verifying patient records, 
we found that the informed consent form was 
available for all GPCC patients whereas at the ICO, 
the signed forms were missing in 7 cases, a signifi- 
cant inter-institutional difference (p=0.0019). 

Existence of a form, booklets, films and other sup- 
porting materials. Both institutions provided ad- 
ditional, detailed information. In the case of the 
ICO, detailed, specific information about the treat- 
ment was included in the informed consent form. 
At the GPCC, the patients were given a brochure 
with general information and a video with more 
detailed information. 

Indicator #5. In vivo dosimetry 

Existence of a protocol and its content I recommendations 
for checking the entrance dose. At the time of study, 
only the GPCC had a protocol in place (as required 
by Polish law). In vivo dosimetry is not used for 
rectal cancer at the ICO. 

Number of verifications (in vivo dosimetry) per pre- 
operative course of radiotherapy. In vivo dosimetry 
was performed on the 2 nd or 3 rd day of the treat- 
ment at the GPCC. Of the 94 patients at the GPCC, 
in vivo dosimetry was considered acceptable in 80 
cases and unacceptable in 14. In these 14 cases, the 
dosimetry was recalculated to reach acceptable lev- 
els. 

Indicator #6. Guidelines for diagnostics 
and therapy 

The GPCC follows the National Comprehensive 
Cancer Network (NCCN) guidelines for diagno- 
sis and treatment of colorectal cancer. 9 In contrast, 
the ICO uses locally-developed guidelines based 
largely on international guidelines (including the 
NCCN), but with some modifications as estab- 
lished by the hospital tumor board. 

At both institutions, patients undergo digital 
rectal exam to determine eligibility for surgery. 
Subsequent assessment may include (depending 



on the institutional protocol) the following: colo- 
noscopy with tumour biopsy, physical examina- 
tion, chest and abdominal-pelvic CT, chest X-ray, 
pelvic MRI, endoscopic ultrasound, and blood 
tests. All GPCC patients underwent x-ray exami- 
nation versus 50% of patients at the ICO. 

Indicator #7. Review of rectal cancer 
patients during the treatment 

At both institutions, patients receiving radiother- 
apy are reviewed once a week by a radiation on- 
cologist. If problems are found, additional exami- 
nations/reviews are possible. This review process 
is governed by the protocols in place at both insti- 
tutions. 

Discussion 

The results of this study reveal that both institu- 
tions had some deficiencies in adherence to the 
quality indicators chosen for preoperative radio- 
therapy for rectal cancer. These findings confirm 
the need for independent audits in radiotherapy to 
identify deviations from good practice and to har- 
monize and determine what good practice is. In the 
paragraphs that follow, we contextualize our find- 
ings for each of the 7 indicators evaluated. 

Waiting times 

Waiting times at the ICO were significantly longer 
for both variables (time from pathological diagno- 
sis to first visit, and time from first visit to treat- 
ment). The wait from the first visit with the radia- 
tion oncologist to treatment at the ICO was double 
that of the GPCC. The reasons for these variations 
are many, but we suspect that main difference is 
that the sources of patient referrals to the ICO are 
much more heterogeneous than at the GPCC. In 
Spain, staging is performed by the radiation on- 
cologist so that if any additional tests need to be 
requested, the start of treatment will be delayed. 
In many countries (including Poland), staging is 
performed before the patient is referred to the ra- 
diation oncologist; as a result, treatment can begin 
sooner. 

Waiting times are perhaps among the most 
important quality variables and it is well-known 
that excessive waits can impact the results of treat- 
ment. 1012 Clearly, the main risk of increased wait- 
ing times is the possibility of tumour growth and 
metastasis. 
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TABLE 4. Type of examination (%) 





Digital rectal 




Ultrasound 




Computed Tomography 




MRI 




exam 


Colonoscopy 


Abdomen 


Transrectal 


Pelvis 


Abdomen 


Chest 




ICO 


100% 


100 


0 


85.3 


98.5 


98.5 


64.7 


89.7 


GPCC 


100% 


100 


100 


3.2 


12.8 


23.4 


0 


21.3 



MRI = magnetic resonance imaging; ICO = Catalan Institute of Oncology; GPCC = Greater Poland Cancer Centre 



Although no standard waiting times have yet 
been established, the National Health Service of 
the United Kingdom published a cancer plan that 
called for waits of no more than 1 month between 
referral by the general practitioner to the start of 
treatment. 13 We believe, based on our experience 
and a literature review, that an optimal maximum 
waiting time should not exceed 21 days from first 
visit to start of treatment. Using these guidelines, 
both the ICO and the GPCC treated the patients in 
a timely manner, despite the large differences be- 
tween the two institutions. 

Treatment interruptions 

Treatment interruptions are another important in- 
dicator of quality that can have a marked effect on 
outcomes. 1416 The usual causes of interruptions in- 
clude machine malfunction or maintenance, toxic- 
ity, holidays, or unplanned quality control checks. 
In such cases, it is essential to have a protocol in 
place to compensate for the interruption. At the 
time of our study, the ICO had a well-established 
comprehensive protocol to guide compensation 
for unplanned interruptions of curative radio- 
therapy. The GPCC had no established protocol at 
the time of the audit, although that has since been 
remedied. 

We found important differences between the 
two hospitals in treatment interruptions, mainly 
because there were none at the GPCC. The GPCC 
patients received a short-course of radiotherapy 
(5 fractions in 5 days), while all 68 of the ICO pa- 
tients (and only 9 GPCC patients) underwent an 
extended course of 25 fractions delivered in 33 
days. For this reason, we can only reasonably com- 
pare results from the two groups who underwent a 
similar radiotherapy schedule. Unfortunately, the 
number of GPCC patients who received this sched- 
ule was too small (9 patients) for meaningful com- 
parisons. Nevertheless, it is important to note that 
82% of patients at the ICO experienced a treatment 
interruption. We know that treatment interrup- 
tions are a common occurrence in radiotherapy. 



This indicates an important quality control issue 
(poor record-keeping) that needs to be resolved. 

In terms of this indicator, both institutions were 
found wanting: the GPCC for lack of a written pro- 
tocol, and the ICO for failing to record the cause 
and responses to interruptions. 

Multidisciplinary approach 

In recent years, more and more medical societies 
and institutions have come to accept the impor- 
tance of using a multidisciplinary approach in 
cancer care to provide patients with optimal treat- 
ment for their specific characteristics. 17 20 In this au- 
dit, we found that 35% of patients at the ICO were 
not presented to the board. However, this does 
not necessarily indicate a quality failure because 
the in-house protocol states that only unusual or 
complicated cases need to be brought to the board. 
Therefore, we must assume that those 35% of pa- 
tients were considered standard cases (i.e., no unu- 
sual conditions). However, steps must be taken to 
assure, in the future, that this information is added 
to the patient records. 

The GPCC was considered deficient in this cate- 
gory because no interdisciplinary treatment board 
was in place at the time of this audit. Fortunately, in 
this case the audit served its purpose, as the GPCC 
instituted a multidisciplinary approach in 2009. 

Portal verification 

Portal Film or EPID (Electronic Portal Imaging 
Detection) is commonly used to evaluate the accu- 
racy of the patient's set up and of the field shape 
and geometry with respect to the treatment plan. 
Repeated verifications during treatments are 
aimed at controlling the stability and the reproduc- 
ibility of treatment conditions. The relevance of 
this procedure varies for different treatments and 
consequently it is suggested to stratify the stand- 
ard in relation to the treatment objective. 

Our results showed that 3 patients at the ICO 
did not have a portal verification. The reason for 
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this is not clear, but may be simply due to a fail- 
ure to record the values in the patient records. 
However, this is a clear quality control failure that 
must be rectified. In contrast, all GPCC patients 
had the necessary verifications and adjustments 
when necessary. 

Informed consent 

At the ICO, there were 7 cases in which we were 
unable to locate the informed consent form (ver- 
sus no cases at the GPCC). While it is possible that 
these forms were never collected, we suspect that 
they were simply misplaced or lost. 

In both countries the law requires that patients 
receive and sign an informed consent form prior to 
treatment. This is a basic patient protection method 
used in most countries. 21 However, the fact that a 
patient signs the form does not necessarily mean 
he/she understands the treatment, as many pa- 
tients will readily sign any document presented by 
the physician. One particularly shocking example 
of this was described by Byrne et al., who found 
that of 100 patients who underwent surgery, 27 did 
not know which organ had been treated. 22 For this 
reason, we believe that patients should be given 
the information in a variety of formats, in addi- 
tion to the legally required informed consent form. 
Aside from the informed consent form and a verbal 
explanation from the physician and/or nurse, we 
recommend that patients be given user-friendly 
brochures and videos that explain the treatment 
in an easy to understand way. We believe that 
our institutions should attempt to standardize the 
provision of information to patients, especially in 
providing written, treatment-specific information 
about the procedure and its expected outcomes 
and side-effects. 

In vivo dosimetry 

In vivo dosimetry is a technique that uses semi- 
conductors to ensure the calculated and measured 
doses are similar. It is used mainly for complex 
techniques and is useful for detecting rare cases 
of over- or underdosing. 23 24 Although the routine 
use of in vivo dosimetry to prevent dosing errors 
may seem to be an obvious quality control meas- 
ure, many centres do not use it. At present, in vi- 
vo dosimetry is not considered standard because 
there are doubts about its costs, time requirements, 
and clinical role, particularly in certain cancer lo- 
calizations. 2527 For this reason, many centers pre- 
fer not to use it for routine procedures, especially 



because modern linear accelerators are believed 
to be more reliable and accurate than older ones. 
However, several authors continue to insist on the 
importance of in vivo dosimetry, notably Williams 
and McKenzie, who wrote an impassioned plea 
for its generalized use. 28 However, we agree with 
the conclusions of a study by the Royal College of 
Radiologists in the UK, which stated that while in 
vivo dosimetry should be used at the beginning 
of treatment for most patients, each department 
should develop its own protocol. 29 For the mo- 
ment, the differences observed between protocols 
at our two institutions serve to illustrate the debate 
about the benefits of in vivo dosimetry for this lo- 
calization and technique. 

Guidelines for diagnostics and therapy 

Few would argue about the value of clinical guide- 
lines provided that these have been prepared by 
expert groups and based on the best available 
evidence and practices. The benefit are many, as 
guidelines serve to standardize best practices, 
guide less-experienced physicians, and use evi- 
dence-based strategies. 3031 The ICO prefers to use 
locally-developed guidelines, which are based on 
and similar to international guidelines such as the 
NCCN. After performing this audit and seeing the 
merits of using guidelines tailored for a specific 
population and resources, staff at the GPCC began 
to develop their own local guidelines. 

Feedback to project partners 

We performed this audit with a number of objec- 
tives in mind. The first and most important was to 
improve quality at our institutions. By identifying 
deficiencies in our processes, we hoped to elimi- 
nate these and so improve our results. We also 
wanted to contribute to the establishment of qual- 
ity control indicators for radiotherapy and for a 
standard audit process. 

Upon completion of the audit, both audit teams 
drafted a report of their findings. The results were 
discussed at a joint meeting, during which we dis- 
cussed the deficiencies and agreed on joint stand- 
ards based on the results of our clinical audit and a 
literature review. 

To close the audit cycle, each institution began 
the process of implementing the newly-agreed 
standards. The intention is to perform a second au- 
dit in the future to verify the actual results of this 
process and to determine the effectiveness and use- 
fulness of the new standards and improvements. 
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This was a retrospective study with a relatively 
small sample. Moreover, for both institutions, this 
was our first experience in performing a clinical 
audit for quality control. 

Conclusions 

We believe that external audit programs such as 
ours can help to improve both patient safety and 
quality of care and this is why the IAEA has called 
for the development of comprehensive quality con- 
trol programs for radiotherapy. 32 35 However, there 
is still a glaring lack of experience in radiotherapy. 

Performing a clinical audit is a time-consuming 
and labour-intensive process. However, despite the 
time and expense involved, the results have more 
than compensated the efforts. As a result of this 
study, both institutions have benefitted as we have 
identified numerous areas to target for improve- 
ment, which we hope will lead to better quality 
treatments and results. Moreover, the procedures 
developed here for rectal cancer can be adapted to 
improve treatment of other tumour localizations. 

Our experience has also shown us that the road 
ahead will not be easy. Even in colorectal cancer, 
in which treatment is generally quite standardized, 
we still found a large gap between two similarly 
structured European hospitals. We believe that an 
independent external clinical audit is an excellent 
method of identifying and rectifying deficiencies in 
quality control procedures. 
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